The Coordinated Interplay Account of Utterance Comprehension, Attention, and the Use of Scene Information
نویسندگان
چکیده
t r a s t , G i l l e t t e e t a l . ( 1 9 9 9 ) s u g g e s t e d t h a t i n f o r m a t i o n f r o m t h e i m m e d i a t e s c e n e w a s l e s s i m p o r t a n t . D e v e l o p m e n t a l fi n d i n g s f u r t h e r d r a w o u r a t t e n t i o n t o p r e r e q u i s i t e s f o r t h e s u c c e s s f u l u s e o f s c e n e i n f o r m a t i o n i n a c q u i s i t i o n : E x p e r i m e n t a l fi n d i n g s s u g g e s t , f o r i n s t a n c e , t h a t t h e i n fl u e n c e o f n o n l i n g u i s t i c i n f o r m a t i o n ( e . g . , o b j e c t s a n d e v e n t s ) o n l a n g u a g e a c q u i s i t i o n i s h i g h l y d e p e n d e n t o n t h e t i m e l o c k b e t w e e n a c h i l d ’ s a t t e n t i o n t o , a n d c h i l d d i r e c t e d s p e e c h a b o u t , t h e s e o b j e c t s a n d e v e n t s ( e . g . , D u n h a m , D u n h a m , & C u r w i n , 1 9 9 3 ; H a r r i s , J o n e s , B r o o k e s , & G r a n t , 1 9 8 6 ; T o m a s e l l o & F a r r a r , 1 9 8 6 ) . I t h a s b e e n s u g g e s t e d t h a t s i m i l a r p r e r e q u i s i t i e s a s f o r c h i l d l a n g u a g e a c q u i s i t i o n a l s o h o l d f o r a d u l t l a n g u a g e c o m p r e h e n s i o n ( e . g . , K n o e f e r l e & C r o c k e r , 2 0 0 6 ) . F i n d i n g s f r o m T o m a s e l l o & F a r r a r ( 1 9 8 6 ) s u p p o r t t h e i m p o r t a n c e o f a t t e n t i o n f o r t h e a c q u i s i t i o n o f c o n c r e t e w o r d s : w h e n a c h i l d ’ s a t t e n t i o n w a s a l r e a d y f o c u s e d o n a n o b j e c t , w o r d s r e f e r r i n g t o i t w e r e l e a r n e d b e t t e r t h a n w o r d s t h a t w e r e p r e s e n t e d w h e n t r y i n g t o r e d i r e c t t h e c h i l d ’ s a t t e n t i o n . B a s e d o n t h e s e fi n d i n g s t h e i m p o r t a n c e o f b o t h l i n g u i s t i c c o n t e x t s / k n o w l e d g e a n d s c e n e c o n t e x t s f o r l a n g u a g e c o m p r e h e n s i o n a n d a c q u i s i t i o n , a s w e l l a s b a s e d o n fi r s t i n s i g h t s i n t o p r e r e q u i s i t e s f o r t h e u s e o f v i s u a l c o n t e x t s i n l a n g u a g e a c q u i s i t i o n r e c e n t p s y c h o l i n g u i s t i c r e s e a r c h h a s m o v e d o n t o e x a m i n e i n m o r e d e t a i l h o w p r e c i s e l y s c e n e i n f o r m a t i o n i n fl u e n c e s a d u l t l a n g u a g e c o m p r e h e n s i o n ( K n o e f e r l e , 2 0 0 7 ; K n o e f e r l e & C r o c k e r , 2 0 0 6 , i n p r e s s ; K n o e f e r l e , H a b e t s , C r o c k e r , &
منابع مشابه
A Connectionist Model of the Coordinated Interplay of Scene, Utterance, and World Knowledge
The interaction of utterance comprehension and information from a visual scene is characterized by the closely time-locked coordination of incremental comprehension and attention in the scene. Comprehension is also anticipatory, as revealed by attention to objects in a scene before they are mentioned. The interaction is further marked by the rapid and seamless integration of, and adaptation to,...
متن کاملLearning to Attend: A Connectionist Model of Situated Language Comprehension
Evidence from numerous studies using the visual world paradigm has revealed both that spoken language can rapidly guide attention in a related visual scene and that scene information can immediately influence comprehension processes. These findings motivated the coordinated interplay account (Knoeferle & Crocker, 2006) of situated comprehension, which claims that utterance-mediated attention cr...
متن کاملThe influence of recent scene events on spoken comprehension: evidence from eye movements
Evidence from recent experiments that monitored attention in clipart scenes during spoken comprehension suggests that people preferably rely on non-stereotypical depicted events over stereotypical thematic knowledge for incremental interpretation. The Coordinated Interplay Account (Knoeferle & Crocker, 2006) accounts for this preference through referential processing (e.g., the verb mediates a ...
متن کاملTo appear in Brain and Language Situated sentence processing : The coordinated interplay account and a neurobehavioral model ∗
Empirical evidence demonstrating that sentence meaning is rapidly reconciled with the visual environment has been broadly construed as supporting the seamless interaction of visual and linguistic representations during situated comprehension. Based on recent behavioral and neuroscientific findings, however, we argue for the more deeply rooted coordination of the mechanisms underlying visual and...
متن کاملThe coordinated processing of scene and utterance: evidence from eye-tracking in depicted events
The monitoring of eye-movements in scenes has revealed that a visual referential context can influence the initial structuring and interpretation of an utterance (Tanenhaus, SpiveyKnowlton, Eberhard, & Sedivy, 1995). These and other findings have influenced frameworks of the language system that permit the interaction of visual and linguistic processing (e.g., Bergen & Chang, to appear, Jackend...
متن کاملSituated sentence processing: the coordinated interplay account and a neurobehavioral model.
Empirical evidence demonstrating that sentence meaning is rapidly reconciled with the visual environment has been broadly construed as supporting the seamless interaction of visual and linguistic representations during situated comprehension. Based on recent behavioral and neuroscientific findings, however, we argue for the more deeply rooted coordination of the mechanisms underlying visual and...
متن کامل